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Abstract Body 



Background / Context: 

As indicated in papers 2 and 3 of this symposium and in published researeh from Projeet 
REAL, there is elear evidenee that the SEALS model has a general positive impact on the sehool 
eontext during the early adoleseent years. This includes teaehers’ enhaneed understanding of the 
peer group social structures formed by students, their management of elassroom soeial dynamies, 
and their self-effieaey for meeting the instruetional and soeial needs of students (Earmer, Hall, et 
ah, 2010; Earmer, Hamm, et ah, 2010; Hamm, Earmer, Dadisman et ah, in press). Other positive 
effeets inelude students’ stronger belonging to and valuing of sehool, students’ sustained positive 
pereeptions of peer norms for aeademic effort, peer eontexts and peer affiliations that are less 
supportive of bullying and aggression, and assoeiated higher levels of academie aehievement 
(Earmer, Hamm et ah, 2010; Hamm, Earmer, Dadisman, et ah, 2010). 

However, as suggested by the findings in paper 3 of this symposium, these effeets tend to 
be at the level of the general school and peer eontext and for youth with low to moderate levels 
of risk for sehool adjustment problems, as well as differentiated by gender. The limited impaet of 
SEALS to the general eontext is expeeted beeause it was designed as a universal model that ean 
serve as a Tier 1 base for seleeted (Tier 2) and indieated (Tier 3) intervention programs. To 
promote the development of intensive Tier 2 and Tier 3 interventions, there is a need to elarify 
faetors and proeesses that are associated with improving or sustained positive patterns of 
aeademie adjustment in general, and in partieular, for high-risk youth aeross early adoleseenee. 
This paper is an initial step in addressing this need. 

Purpose / Objective / Research Question / Focus of Study: 

The purpose of this study was to identify key proeess faetors that support gains to 
aeademie outeomes in general, but speeifieally for students at-risk for sehool sueeess. Sueh 
analyses will reveal meehanisms and / or student risk eonfigurations that are not responsive to 
the universal intervention, and that should be eonsidered as possible targets for further 
intervention. Thus, the foeus of these analyses was not on the impaet of the SEALS intervention 
but on differential patterns of adaptation of high-risk youth in relation to a variety of proeess 
variables that are possible mechanisms of change. Therefore, the analyses were eonducted across 
the intervention and eontrol samples with an emphasis on variables that distinguished high-risk 
youth who had positive aeademie outeomes from those who did not. 

Setting: 

Projeet REAL took place in publie schools serving sixth graders; schools were configured 
as either middle (grades 6-8) or k8/kl2 sehools. Sehools were loeated in the Appalaehian, Deep 
South, Southwest, Paeific Northwest, Par West, Southeast, Northern Plains, and Midwest regions 
of the United States. Partieipating sehools were loeated in low-wealth eommunities designated as 
rural by the National Center for Education Statistics (NCES). 

Population / Participants / Subjects: 

The eurrent study included 28 Projeet REAL schools (14 matched pairs); 57% were 
middle sehools. On average, the pereentage of students eligible for free/redueed lunch was 
61.52% (SD = 28.91). Schools ranged from 0% to 100% minority (M= 33.80%, SD = 38.99). On 
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average 59% of students were at or above grade level for reading and math standardized test 
seores. Consent rate averaged 64.7% (SD = 13.69). Sehool size ranged from 72-581 students. A 
total of 1587 students partieipated; 831 were female. 

Teaehers in intervention sehools took part in the intervention eomponents deseribed 
below. Teaehers in both intervention and eontrol sehools partieipated as researeh partieipants. 

All were sixth grade teaehers; 72.6% were female, 47.2% held a graduate degree, 38.4% had 
done some graduate work, and 14.4% reported their highest degree as a four-year degree. 

Student partieipants were the sixth grade students of these teaehers in the intervention and 
eontrol sehools. For these students, 53.6% were female and 51.3% were elassified as ethnie 
minority (Afriean Ameriean, Latino, or Native Ameriean ethnieity). 

Intervention / Program / Practice: 

The SEALS intervention is a professional development program that trains 6^*' grade 
teaehers in the use of three eomplementary intervention eomponents designed to foster 
supportive sehool eontexts in early adoleseenee. 

Academic Engagement Enhancement (AEE). The foeus of this eomponent is on researeh- 
based strategies for strueturing and organizing the learning environment to maintain the attention 
and involvement of all students’ diffieulties (Gut, Farmer, Bishop, Hives, Aaron, & Jaekson, 
2004; Sutherland & Farmer, 2007). 

Competence Enhancement Behavior Management ( CEBM). From the CEBM eomponent 
(Farmer, Goforth, Hives, Aaron, Jaekson, & Sgammato, 2006; Sutherland & Farmer, 2007), 
teaehers learn to teaeh and reinforee appropriate elassroom behavior while providing 
eonstruetive eonsequenees to reduee problem behavior. The model was developed from 

evideneed-based praetiees for promoting positive elassroom behavior (e.g., Johns & Carr, 1995; 
Fewis, Sugai, & Colvin, 1998; Nelson, 1996; White, Algozzine, Audette, Marr, & Ellis, 2001). 

Social Dynamics Management (SDM). SDMis an inserviee training and direeted- 
eonsultation model to enhanee teaehers’ awareness of elassroom soeial dynamies and the 
eorresponding impaet of sueh dynamies on students’ aeademie engagement and elassroom 
behavior (Farmer, 2000; Farmer & Xie, 2007; Farmer, Xie, et ah, 2007). Teaehers learn to 
identify students’ peer groups, soeial struetures, and soeial roles (e.g., leaders, followers, 
isolates) in the peer system, as well as how to reeognize and prevent bullying and soeial 
aggression. 

Eaeh intervention eomponent is designed to eomplement the others, resulting in a 
eolleetive impaet on what teaehers do in the elassroom (e.g., teaeher attunement); how teaeher 
funetioning influenees student funetioning and ereates a peer and elassroom eontext that supports 
and reinforees positive student funetioning; and how, in turn, teaeher funetioning, sehool and 
peer eontext eonditions, and student funetioning eontribute to students’ aeademie outeomes (see 
Figure 1). The model refleets the idea that in order to promote positive adjustment in early 
adoleseenee, it is important to reorganize the aeademie, soeial, and behavioral eapaeities of both 
students and their sehooling eontexts. 

Training. The goal is to teaeh teaehers speeifie strategies, and provide them with a 
framework for using these strategies in a systematie manner to promote a supportive and 
engaging sehool eontext. SEALS is multieomponential and designed to move teaehers’ 
understanding and skill-set from more general to more advaneed levels. Training involves: 1) a 
site visit by intervention staff that ineludes direeted observations and eonsultation with 6^*' grade 
teams of teaehers and sehool personnel in the spring semester prior to the intervention year; 2) a 
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1 day summer institute immediately prior to the beginning of school that provides an 
introduction to the three intervention components and involves direct instruction, group 
discussion, and hands-on activities to present and discuss the content; and 3) teachers’ 
completion of 8 self-guided web-based instructional modules between September and March; 
and 8 directed consultation sessions corresponding to on-line modules, and accomplished 
through videoconferencing between intervention staff and the 6* grade teacher team at the 
school. On-line mechanisms are used to respond to issues that arise from geographic isolation of 
rural school districts. 

Research Design: 

Project REAL followed a cluster randomized control trial (CRCT) design, in which 
matched pairs of schools were identified and recruited for participation, and one of each pair was 
randomly assigned to the intervention or control condition. Paired schools were matched on 
multiple demographic variables (school size, student achievement, percentage minority, student 
poverty). Intervention schools received a professional development program for all sixth grade 
teachers (available to control schools following the end of Project REAL). The study followed a 
longitudinal design; baseline data were collected pre-intervention (spring of 5**’ grade), and 
during and post-intervention (fall and spring of sixth grade). Data sources included teacher and 
student survey completion, classroom observation, and school records. 

Eidelity of intervention training was documented via logs of teacher participation. Project 
REAL teachers completed an average of 27.55 {SD =3.76) hours of professional development. 
Fidelity of teacher implementation was determined by classroom observation of intervention and 
control school teachers by trained observers blind to condition. The instrument used was aligned 
with the intervention components and had acceptable psychometric properties scale reliability of 
.831-. 929 (Cronbach’s alpha, range for subscales) and .92 (overall scale), and interrater 
reliability of .881 (Kappa). Multilevel analyses for CRCT indicated that the instructional 
practices and classroom environments were significantly more aligned with the ideals of the 
intervention in intervention versus control schools (Hamm & Farmer, under review). 

Data Collection and Analysis: 

Data collection included gathering information via multi-informant measures to capture 
students’ and teachers’ perspectives of the peer context as well as participants’ school adjustment 
and related risk factors. Student data were collected on-site in a group administration format, 
following a protocol that has been used with elementary school age students by the Project 
REAL Pis for over two decades. Teachers completed their assessments of study participants 
separately. Students received small gifts, and teachers received financial remuneration, for 
participating in the study. The following instruments were used for the current study: 

Interpersonal Competence Configurations (ICCs). Configurations were generated from 
teachers’ responses to the Interpersonal Competence Scale-Teacher (ICS-T), an 18-item 
questionnaire consisting of seven-point Likert scales (Cairns, Leung, Gest, & Cairns, 1995). The 
ICS-T yields composite scores on multiple sub-scales: aggression, popularity, academic 
competence, affiliative, internalizing, and Olympian, as well as a total score that signifies overall 
student adjustment. Multiple studies indicate strong psychometric properties for this instrument 
(e.g., Cairns & Cairns, 1994; Cairns, Leung, Gest, & Cairns, 1995; Farmer, Irvin et ah, 2006). 

Cluster analyses (Aldenderfer & Blashfield, 1984) of ICS-T scores were used to 
discern distinct risk configurations separately for boys and girls at the end of the 5* grade (Wave 
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1) and end of 6**^ grade (Wave 3). The resulting male and female eonfigurations for Wave 1 are 
presented in Tables 1 and 2. Labels are assigned with respeet to whether or not students in a 
given eluster were higher or lower than average with respect to the 8 ICST subscales (i.e., 
aggression, affdiative, internalizing, academics, etc.). 

School Valuing. Students rated their agreement with items such as “most of the things we 
learn in class are useless” on VoelkTs (1996; 1997) widely used scale of the perceived 
worthiness of school to one’s future. Cronbach’s alpha exceeded .80 across studies; construct 
validity has been established through high correlations with academic achievement and class 
participation (Finn & Frone, 2004; Voelkl, 1996; 1997). 

School Belonging. On Hagborg’s (1998) Psychological Sense of School Membership- 
Brief (PSSM-B) scale which focuses on the affective ties students feel toward their schools, 
students rated their agreement with statements such as “I am treated with as much respect as 
other students.” Strong psychometric data has been reported for this scale (e.g., Hagborg, 1998; 
Hamm, Farmer, Dadisman, & Robertson, 2007; 2009). 

Social Preference. Using established sociometric procedures (e.g.. Cole, Dodge, & 
Coppotelli, 1982), students nominated up to three students they liked most (LM) and least (LL). 
Social preference was calculated as the standardized number of nominations received for LM 
minus the standardized number of nominations received for LL (Coie & Dodge, 1983). 

School Record Data. Schools provided participating students’ scores on statewide tests 
of reading and mathematics, as well as students’ overall grades. These scores were standardized 
within state to put them on a common metric (i.e., Z-scale). Grades were standardized by putting 
them on a 0 - 100 scale. 

General Analytic Strategy. The dependent variables in these analyses were Wave 3 
(spring of 6* grade) academic outcomes (grades, standardized test scores). The first set of 
analyses involved the total sample of REAL participants, and examined wave 2 (fall) and wave 3 
(spring) process variables (e.g., school belonging, school valuing, social preference) as predictors 
of academic outcomes, after controlling on the academic outcome for the prior year. Next, 
analyses focused on students classified into one of the risk configurations (unengaged, studious, 
tough, and aggressive or multirisk for boys; aggressive, affiliative/intemalizing or multirisk for 
girls). Analyses, performed separately by gender, examined relations among process variables 
and academic outcomes, to identify particular factors that promoted achievement gains among 
students at-risk (controlling for prior year academic outcome). Subsequent analyses focused on 
the interactions of particular process variables with specific configurations, to determine if 
students of particular types of risks benefited from particular school experiences. Generalized 
linear models (McCulloch & Searle, 2001) were used for all analyses. 

Findings / Results: 

For the full sample (i.e., risk and non-risk students; males and females combined), 
multiple SEALS process variables were associated with an improvement in student academic 
achievement. For student grades. Waves 2 and 3 school belonging, school involvement, and 
social impact were positively associated with Wave 3 grades (b’s ranged from .468 - .999, p < 

.01 for each), controlling on prior year grades. For standardized test scores (math and reading) 
school involvement at Wave 2 and Wave 3 was positively associated with Wave 3 test scores 
(b’s range from .083 to .141, p < .05), net of prior year test scores. In addition, social preference 
scores at Wave 2 and Wave 3 were positively associated with Wave 3 test scores (b’s are .049 
and .044, p < .05), net of prior year test scores. Finally, Wave 2 school belonging, school 
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involvement, and soeial impaet were positively assoeiated with Wave 3 composite ICST score 
(b’s ranged from .100 - .174, p < .01 for eaeh), eontrolling on Wave 1 eomposite ICST seore. 

Among boys identified as at-risk. Wave 2 sehool belonging, sehool involvement, and 
soeial impaet were positively assoeiated with Wave 3 grades (b’s ranged from .551 - 1.408, p < 
.05 for eaeh), eontrolling on prior year grades. Parallel effeets were found for the same proeess 
variables measured at Wave 3 (b’s ranged from 1.1 - 1.3, p < .05 for eaeh). For standardized 
test scores. Wave 3 sehool belonging had a positive assoeiation with Wave 3 seores (b = .131, p 
< .05), net of prior year standardized test seore. Wave 2 sehool belonging, sehool involvement, 
and soeial impaet were all positively assoeiated with Wave 3 composite ICST score (b’s ranged 
from .135 - .167, p < .05 or better for eaeh), eontrolling on prior year composite ICST scores. 

For the sample of girls identified as at-risk. Wave 2 sehool involvement was positively 
assoeiated with Wave 3 standardized test score (b = .321 ,P< .01), net of prior year seore. 

In preliminary analyses involving a limited number specific risk confisurations . for 
Tough boys, sehool belonging at Wave 2 and at Wave 3 (b = 2.637 and 1.698, p < .01) was 
positively assoeiated with Wave 3 grades net of prior year grades; as was Wave 2 sehool 
involvement (b = 2.400, p < .01). For Aggressive girls. Wave 3 sehool involvement had a 
positive assoeiation with grades (net of prior grades, b = 2.321, p < .05); for Multi-Risk girls. 
Wave 2 soeial preferenee was positively assoeiated with Wave 3 grades net of Wave 1 grades (b 
= 1.142, p < .05). Analyses also identified relationships between proeess variables sehool 
involvement and soeial preferenee with standardized test seores for Unengaged and Multi-Risk 
boys and Multi-Risk and Aggressive girls. 

Conclusions: 

The eurrent findings provide new insights into mechanisms that may contribute to gains 
in academic achievement for early adolescent boys and girls, particularly those at-risk for school 
failure. Findings for the whole sample support the SEALS model, particularly the importance of 
aspects of social status, experiences of the social-affective context, and student dispositions 
toward schooling. However, these findings highlight the need to attend to gender differences in 
Tier II and III follow-up interventions. For boys, dispositions toward school and aspects of social 
status differentiated the academic gains for boys at-risk. These dispositions were not influenced 
by the SEALS universal intervention (see paper 3) for boys in high-risk configurations; Tier II 
and Tier III intervention follow-up with respect to these types of process variables may be 
effective in promoting the academic success of high-risk boys. However, more positive school 
dispositions, social status, and experiences of the social-affective context did not consistently 
differentiate academic gains of high-risk from low -risk girls. In general, more attention is 
necessary to understand how to promote academic gains among at-risk girls, but aspects of social 
status and school involvement at minimum should be of focus in Tier II and III follow-up 
interventions. Additional analyses will be conducted to clarify further which specific risk 
configurations are in need of targeted intervention, and the process factors that are optimal 
targets for Tier II and III intervention follow-up among at-risk boys and girls. 
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Appendix B. Tables and Figures 



Figure 1: Intervention Model 
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Table 1 

Boys ’ Interpersonal Competence Configurations at Spring of Pre-Transition Year (Wave 1) 



Clustering 

Variable Unengaged Studious Tough Aggressive Multi-Risk Model 



ICS-T Factor 



Popular 


-.57 


(.68) 


*** 


-.17 


(.67) 


* 


.75 


(.60) 


*** 


-.41 


(.71) 




-1.59 


(.58) 


* 


1.04 


(.61) 


*** 


Olympian 


-.61 


(.70) 




-.26 


(.61) 




.60 


(.69) 




-.24 


(.71) 


*** 


-1.54 


(.73) 


*** 


1.12 


(.64) 


*** 


Affiliative 


.01 


(.79) 




.18 


(.70) 




.48 


(.67) 




-.73 


(.74) 




-1.59 


(.88) 


*** 


.88 


(.59) 


*** 


Academic 


-1.14 


(.47) 


*** 


.54 


(.57) 


*** 


-.25 


(.81) 




-.11 


(.85) 




-.44 


(.98) 




1.19 


(.41) 


*** 


Internalizing 


.61 


(.83) 




.50 


(.74) 




-.68 


(.64) 




-.16 


(.68) 




1.52 


(.81) 


*** 


-.74 


(.74) 


*** 


Aggressive 


-.42 


(.69) 




-.65 


(.64) 




.27 


(.73) 




1.09 


(.60) 




.38 


(.98) 




-.89 


(.66) 


*** 


Cluster n 




97 






111 






134 






137 






48 






102 





Note. N = 629 boys. Cells contain means on ICS-T clustering variables for corresponding interpersonal competence configuration (standard deviations given in parentheses). 
***p < .001, **p < .01, <.05 for the T-tests of the mean (versus a value of 0). 
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Table 2 

Girls’ Interpersonal Competence Configurations at Spring of Pre-Transition Year (Wave 1) 



Clustering 

Variable 


Aggressive 




Studious 




ICS-T Factor 














Popular 


-.21 


(.79) 




-.07 


(.72) 




Olympian 


-.19 


(.71) 




.04 


(.65) 




Affiliative 


-.58 


(.76) 


*** 


.23 


(.70) 




Academic 


-.25 


(.82) 


*** 


.54 


(.057) 




Internalizing 


-.14 


(.76) 




.23 


(.68) 




Aggressive 


1.33 


(.69) 


*** 


-.59 


(.48) 




Cluster n 




143 






178 





Affiliative 

Internalizing Multi-Risk Model 



1 

00 


(.71) 


*** 


-1.22 


(.71) 


*** 


1.04 


(.53) 


*** 


1 

o 


(.65) 


*** 


-1.16 


(.77) 


*** 


1.02 


(.65) 




.30 


(.64) 




-1.52 


(.80) 




.74 


(.56) 


*** 


-1.21 


(.65) 


*** 


-.72 


(.87) 


*** 


.72 


(.62) 


*** 


.45 


(.80) 


*** 


1.24 


(.79) 


*** 


-.92 


(.66) 


*** 


-.36 


(.63) 




.25 


(1.09) 




-.33 


(.74) 


*** 




113 






92 






201 





Note. N = 727 girls. Cells contain means on ICS-T clustering variables for corresponding interpersonal competence configuration (standard deviations given in parentheses). 
< .001, **p < .01, <.05 for the T-tests of the mean (versus a value of 0). 
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